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Integration of Unmanned Aircraft Systems 
(UAS) in the National Airspace System (NAS) 


e Detect-and-Avoid (DAA) system must enable UAS to 
steer clear of potential collisions with other aircraft 
Replace the FAA's “see-and-avoid” requirement when 


there is no pilot onboard with the same or better safety 
How to quantify “well-clear’? 


How to communicate with ATC and pilots-in-control? 


How to interoperate with TCAS or ACAS-XU? 
How to ...? 


The Problem: 


How to build a model of DAA system that would help 
establish requirements to future DAA systems? 
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The Need: 


Conflict detection and resolution algorithm for DAA system 
modeling 
e Flexible 


to use as a testbed for evaluating new features of DAA 
systems 


e Fast 


for real-time (human-in-the-loop) and faster than real-time 
(parametric and NAS-wide) simulations 


e Lightweight 
easy to integrate in our DAA system model 


asa GRACE Algorithm at a Glance 


Flexible: open architecture 


e Use any suitable trajectory predictor 
e Configurable 
© separation standards 


oO maneuver types (horizontal / vertical / speed) 
o cost functions 


e Composed of two loosely coupled algorithms 
o Generic Conflict Evaluator (GCE) 
o Generic Resolution Advisor (GRA) 


Fast: execution time ~ milliseconds 


Lightweight: seamlessly integrated into DAA simulation 
e Simple API and implementation 


@ Small jar with minimal dependencies 


asa Generic Conflict Evaluator (GCE) CEI 


USR 


WN CONSULTING, I 


Definitions: 


Ownship: aircraft controlled by DAA system 

Intruder: other aircraft that can create a collision threat 
Separation standard: a logical condition of safe separation 
Violation (loss of separation): violation of separation 
standard 

Threat: violation properties 

o Severity level 

o Closest Point of Approach (CPA) 

o Time of first loss of separation 

OO est 

NMAC: Near-Mid-Air-Collision / violation of NMAC zone 
Encounter (conflict): a flight situation resulting in violations 
occurred at least at some trajectory states 
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Accepts multiple separation standards configurable to 


cover the wide range of spatial and temporal scales 
e Horizontal separation or Horizontal Miss Distance HMD 


e Vertical separation VSEP 
e Time metrics 


O 


O 
e. 
O 


tau or tauMod (tau with distance modifier DWOD) 
altitude-dependent tau (as per TCAS sensitivity levels) 
vertical tau (time to co-altitude) 

time to CPA or to first loss of separation 


Examples 


@ DAA Well Clear as defined by the Minimum Operational 
Performance Standards (MOPS) for DAA systems (expected to be 
published in June 2017): 

HMD > DMOD = 0.66 nmi, VSEP > 450 ft, tauMod > 35 sec 

e NMAC (as defined for TCAS): 500 ft x 100 ft 
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Grid-based threat detection 


Request predicted intruder trajectories at discrete time steps 

Determine grid cell size from separation standards and max. speeds 
Map intruders to grid cells (stored as a time sequence of hash maps) 
Detect threats from intruders mapped to cells in proximity to ownship 


ma oi aa 


Bounding box based on 
separation standards 


> (max. speed) x (time step) 
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Start from CPA for highest priority threat from GCE 
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Extrapolate trajectories backward from CPA 


ime 
. 
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Apply Simple Maneuver to linearized ownship trajectory 


Increment control variable , 
Update velocity vector 

Estimate new CPA 

Check separation standard at new CPA 
Still violation? Repeat 


on 


Simple Maneuvers (SM) 
Turn Left 


Turn Right 
Vertical Up 
>, Ax, Ay; 
top, —max{0, — = 
CPA > (Avy Vertical Down 
Pi : oe 
of Ax, = (%;-%p),, Av, =;- Vo), Speed Up 


Speed Down 


x 
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Apply Simple Maneuver to linearized ownship trajectory 


Increment control variable a 
Update velocity vector 

Estimate new CPA 

Check separation standard at new CPA 
No violation? Repeat one more time just 


Simple Maneuvers (SM) 


a ce 


to be sure Tonio 
Turn Right 
Vertical Up 
>, Ax, Ay; 
t = jnax<Q, — - 
CPA > (Avy Vertical Down 
- 22° : we” 
oF Ax, = (%;-%p),, Av, =;- Vo), Speed Up 


Speed Down 


x 
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Re-evaluate the candidate resolution for all intruders 


1. Last CPA becomes a Trajectory a 
Change Point (TCP) 


2. Pass TCP into GCE for re-evaluation 
3. GCE uses the TCP as a constraint to 

generate the updated trajectory that is oe Simple Maneuvers (SM) 

checked for violation aor" Turn Left 

Turn Right 
Vertical Up 
ae . Vertical Down 

Pa Re-evaluation failed? i 


e Yes: continue with the same glen 
. Speed Down 
Simple Maneuver \ 


e No: remember a candidate 
resolution and apply next 
XK Simple Maneuver 
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Find the best solution using a configurable cost function 


Threat of collision cost: 

Oo penalizes for collision threats from all intruders 

o naturally dominates when close to collision 
Maneuver change cost: penalizes frequent changes of 
maneuvers 

Rank cost: favors the right-of-way compliant maneuvers 
Maneuver strength cost: penalizes too aggressive 
maneuvers 

Other costs can be added if needed 


NAS-wide 24-hour study 


About 20K UAS missions distributed geographically and 
temporally (Ayyalasomayajula et al, 2013) 

VFR traffic based on recorded nation-wide radar data 
Transitional class E airspace 

Mix of cooperative and non-cooperative traffic 

DAA surveillance included a directional airborne radar 
with 8-nmi range 

Possible late detections by surveillance due to 

o “Noisy” VFR tracks 

o Limited sensor field of view 

Unknown intruder intent 

Separation standards based on DAA Well Clear 


Simulations 


1. 
2. 


Unmitigated: detection only, no resolutions (baseline) 
Mitigated: detection and resolutions with immediate 
execution and “recapture” 


Metrics 


Violations: DAA Well Clear violated 

NMAC: NMAC separation standard violated 
Predicted: per cycle (at every simulation timestep) 
Actual: per encounter (at CPA) 

Sumac: Separation at CPA relative to NMAC: exceed 
100% for Actual NMAC; lower values correspond to 
larger separations 


NAS-wide study: effect of mitigation 


Evaluation of GRACE Algorithm 


Simulation 


Unmitigated 
Mitigated 


Predicted 
Violations 


115409 


14394 


Actual 
Violations 
1894 


Predicted 
NMAC 


Actual 


NMAC 


Mean 


Snmac (%) 


92.2 
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e Mitigation substantially reduced the number of violations 


e Remaining violations are mostly due to late detections 


by surveillance or unexpected intruder maneuvers 
e Mitigation eliminated all actual NUACs 


asa Conclusion CCI 


GRACE Algorithm 


e Met performance requirements of DAA simulations 
e Validated and used to inform DAA MOPS in a number 
of 
o human-in-the-loop experiments 
o flight tests with live aircraft 
o NAS-wide simulations and parametric studies 
e Can be used by manufacturers and developers of 
o decision support tools for pilots in command 
o systems for fully autonomous UAS DAA operations 
o research and automation software for manned flights 


Future work 


e Improve robustness of DAA resolutions, taking into 


account uncertainties of intruder positions and intent 18 
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Questions / Discussion 


Contact 
Michael Abramson 
Senior Engineer 
Crown Consulting Inc. 


michael.abramson@nasa.gov 
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General purpose conflict detection and 
resolution algorithm 


e Fast and lean 

e Designed without any assumptions regarding: 
o temporal and spatial scales 
o performance capabilities of aircraft 
o sensor and communication systems 
o degree of autonomy 

e Can be used: 
o in decision support tools for ground pilots 
o in fully autonomous UAS DAA operations 
o potentially in manned flights 

e Used extensively in research on UAS DAA systems 
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2012: The U.S. Congress mandated the “safe integration” of 
Unmanned Aircraft Systems (UAS) in the National Air Space (NAS) 


v 


2012: The FAA aviation rulemaking committee is looking into 
amending Part 91.113 that prescribes aircraft right-of-way rules, to 


allow for an electronic “Detect-and-Avoid” (DAA) system enabling 
UAS to steer clear of potential collisions with other aircraft 


ww 


2013: The RTCA is developing the minimum operational 
performance standards (MOPS) for a UAS DAA System 


VZ 


2013: NASA developed a portable software system, Java 
Architecture for DAA Extensibility and Modeling (JADEM) 
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Background 


UAS Integration in the NAS: NASA Ames role 


e determine the required information to be displayed in the Ground 
Control Station (GCS) to support the development of standards and 
guidelines through prototyping and simulation 

e analyze integration of UAS control and communication system and 
ATC communications to validate recommendations for regulations 
and standards 

e collect and analyze UAS hazard and risk related data to support 
safety case recommendations for the development of 
certification/regulations 

e conduct a “virtual” type design certification effort to develop a “UAS 

playbook” for industry to obtain type design certificates 


e instantiate a GCS with display/information to demonstrate 
compliance with requirements 
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* Piloted Simulators 


* Flight Assets 
~ Manned 


~ UAS 
* Piloted Simulators 
* ATC (HD TRACON) 
* Restricted Airspace 
» ADS-B infrastructure 
* Voice Communications (NVS7?) 


Background 


HLA Environme 


* Flight Assets 
~ Manned 
~ UAS 

* Piloted Simulators 

* ATC Sim 

* Target Generation 

* Voice Communications 

* Real-time Traffic Surveillance 
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Design philosophy 


Simple interface and customization 

Few generic classes vs. many 
specialized classes 

Use Bridge and Adaptor design patterns 


One system - many clients 
Unified unit conversion 
Low-level flight data management 
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services and spinoffs 


Grid-based mapping for any 2D targets 

o useful for fast search of “neighbors” in 2D space 

Unit conversion and operations with dimensional 

variables 

o time, space, speed, angle, and mass variables 

Generic flight data management classes 

o natural “language” to express any data, constraints, 
and operations for aircraft states and entire flights 

Multimodal Adaptable Trajectory Generator (MATG) 

Oo ageneral purpose TP, more flexible than others 

Generic surveillance (Sensors) model 

GRACE 
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High-level architecture 


e Ownship: initial state and constraints (intent) 
e Intruders: initial states and constraints (if known) 


i Thr tor - 
Look-ahead time and 
Separation standards Intr > mapping jk 4 > 


eatEvalua 
ers = 
0 2D grids Trajectory 
Inruderstate| | Threat? |__| 
StateThreatDetector 


Ownship state 
Ownship state at CPA 
Threats for all detected intruders 
1st Threat 


SaaConflictResolver 
Maneuvers => Solutions 
Cost 
Cost factors 


Ownship constraints 


SaaResolution: Solution => Cost 
e Avoidance maneuver 
e Ownship predicted trajectory 
e New and unresolved threats 


Overview of GRACE Algorithm CCI 
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Key ideas 

e Threat evaluation with configurable separation 
standards 

e Grid-based mapping (Von Viebahn, Watkins) 

Outputs 

e All intruder states mapped to 2D cells for all timesteps 
up to a specified look-ahead time 


e Violations of separation standards (threats) with Closest 
Points of Approach (CPA) 
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Separation standards (multiple severity levels) 


Horizontal and vertical separation 
Horizontal miss distance 
Tau-separation, which can be a 


simple tau: t= — +5, 0Fr 
_ a ae 
modified tau: t,,,;= — ==“, or 


altitude-dependent tau as defined by TCAS 
sensitivity levels 


time to separation as a filtering condition. 
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Key ideas 

e Local optimization at CPA for highest priority threat 

e Discretized solution space by considering a small set of 
simple maneuvers 

e Each candidate resolution is represented by a single 
Trajectory Change Point (TCP) 

e Call GCE to re-evaluate the candidate resolutions for all 
intruders 


Outputs 


e A set of conflict-free resolutions (one for each simple 
maneuver) 
e The best (least cost) solution 
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TCP for linearized trajectories 


Simple Maneuvers (SM) 
Turn Left 


Turn Right 


Vertical Up 


Vertical Down 
we 
Speed Up 


Speed Down 


x 
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Parametric study 
e 180 encounter geometries for demanding conditions 
e Configurations 
o Baseline with “perfect” omnidirectional sensor and 
immediate execution of GRACE maneuvers 
o Directional airborne radar model paired with a 
tracker with and without sensor error (“noise”) 
o Model of delayed execution of GRACE maneuvers 


NAS-wide study 


e UAS missions and recorded VFR traffic for 24 hours 
e Baseline configuration 
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Metrics 
Violations: any separation standard violated 


NMAC: Near-Mid-Air-Collision zone (500 x 100 ft) penetrated 
Predicted: per cycle (at every simulation timestep) 
Actual: per encounter (at CPA) 


Changes Per Encounter: number of changes in resolution 
type divided by the number of encounters 


Failure Rate: a ratio of number of Actual Violations to 
number of encounters in % 


Symac: S¢Paration at CPA relative to NMAC: exceed 100% 
for Actual NMAC; lower values correspond to larger 


separations 
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Parametric study: effect of surveillance system 


Failure 
Rate (%) 


Predicted 
Violations 


Actual 


Violations 


Predicted | Changes per 
NMAC | Encounter 
0.056 

0.006 


Sensor 


Omnidirectional | 


Directional perfect 


34.3 
+ 


Snmac (%) 
Mean 


Max 


39.5 


Directional noisy 


| | 31.8 


| 46.8 


e Resolved all conflicts that were not detected too late 
e Number of changed resolutions per encounter 
o very low for perfect sensors 
o increased for noisy sensors due to large vertical 
errors of non-cooperative radar sensor 
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Parametric study: delayed pilot response 
Total Pilot Predicted | Predicted | Changes per Actual Failure Snmac (7%) 


Delay 


10 seconds 


Violations NMAC Encounter Violations | Rate (%) 
3419 2636 ss 
4686 3463 


Mean 


| Max 


15 seconds 12:5 


9.9 14.7 


20 seconds 


Even for largest pilot delay (20 sec): 

e All NMACs avoided with a comfortable safety margin 
e Less than 4% encounters with Well Clear violations 
e ~1 changed resolution per encounter 


Pilot delay assumed by GRACE (the algorithm delay): 15 sec 


35 


